# Multi-task fine-tuning adaptation

Hubert is a self-supervised learning-based speech representation model that learns joint acoustic and linguistic representations of speech through BERT-like predictive loss.

Catalan pre-trained language model based on RoBERTa architecture, developed by Spanish government agencies